" flgMPCT/PTO 12 APR 2005 

WO 2004/036572 PCT/IB2003/004283 

1 10/531031 

Method and apparatus for retrieving data 



The invention relates to a method of retrieving data requested by a host from a 
first memory divided into allocation units. 

The invention further relates to an apparatus for retrieving data requested by a 
host from a fibrst memory, comprising means for receiving data from the first memory, the 
5 first memory being divided into allocation units; a second memory; and a central processing 
unit. 

The invention also relates to a system for reproducing audio-visual 

information. 



10 

Such a method, apparatus and system are known from US patent appUcation 
US-A-2001/0021983. This document proposes a method of relocating defective sectors on a 
harddisk platter to sectors in a spare area on the platter, and an apparatus for performing this 
method. According to the method presented in said patent appUcation, the spare areas are 

15 located outside the data area, either on the outside or inside of the disk platter. 

When retrieving data from a group of sectors on the harddisk platter, in which 
group certain sectors are defective and therefore relocated to sectors in a spare area, the 
reading head has to switch from an area on the disk platter where the group of sectors is 
located to either one of the spare areas. Although said patmt appUcation proposes 

20 embodiments for reducing the performance penalty incurred by switching of the head, there 
wiU always be a performance penalty when retrieving data from said group of sectors. This is 
because the reading head will always have to make a switch (or "'sweep") fix>m tibie normal 
data area to the sectors in the spare area. 

This is a disadvantage of the prior art. Harddisk drive systems are more and 

25 more used for audio-visual appUcations, which require optimal real-time performance and 

bandwidth of such systems. Especially when multiple streams of audio-visual information are 
streamed from the harddisk drive system — or any other kind of memory device - 
performance penalties that occur during streaming may cause buffer underflow. When 
retrieving a stream of audio-visual information for playback, this may result in hick-ups in 
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the presentation of the stream on soreen. This not only goes for performance penalties caused 
by out-of-bound relocation of defective sectors, but also for so-called "soft defects", sectors 
of which data has to be read multiple times before obtaining llie correct data. 

Furtheraiore, it is known ftom practice that files, either data files or streams of 
5 audio-visual information, may be stored in fragments on the harddisk platter. Switching firom 
one fragment to another may incur a performance penalty as well, the reading head has to 
switch from one area on the harddisk platter to another. During this sweep, no data is read. 



10 It is an object of the invention to further reduce the performance penalties of 

memories during data retrieval. 

This object is achieved by the method according to the invention and is 
characterized in that it comprises the steps of: determining in which allocation units the 
requested data is stored; searching a list of references to allocation units to determine whether 

IS the list comprises a reference to at least one of tiie allocation units determined in the previous 
step; when a reference to at least one allocation unit determined in the first step is comprised 
in the list, storing a first part of the data stored in the at least one allocation unit in a second 
memory; and retrieving the requested data, wherein the first part of the requested data is 
retrieved from the second memory and a second part of the requested data is retrieved from 

20 the first memory, the second part of the requested data being complementary to the first part 
of the requested data. 

By caching certain parts of the requested data prior to retrieval of the fiill 
amount of data, problems inherent in retrieval of certain parts of the requested data will not 
occur during retrieval of the fiill amount of data. One could think of damage done to a disk 

25 platter of a harddisk drive, making it difficult to retrieve certain data. When all the requested 
data is retrieved in a sequence, e.g. in a streaming mode in case of a stream of audio-visual 
data, and problems occur, the real-time performance of a system using the method according 
to the prior art may be jeopardized. For example, when a couple of re-read attempts are made 
during retrieval of data, a buffer-underrun may occur, resulting in a black screen for a user. 

30 This kind of problem may be prevented when using the method according to the invention, 
when building the list from references to allocation imits in which data retrieval are known to 
cause problems like performance penalties. 

In an embodiment of the invention, the first memory has a nominal data 
retrieval rate and the list is built up by using a mediod comprising the steps of: monitoring an 
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average retrieval rate with which data is retrieved fix>m the first memory; determining 
whetiier the average retrieval rate drops below the nominal data retrieval rate; when the 
average retrieval rate drops below the nominal data retrieval rate, determining a part of the 
data of which retrieval causes the drop of the average retrieval rate; adding to the list a 
5 reference to the allocation units in which data is stored of which the retrieval causes the drop 
of the average retrieval rate. 

It is advantageous to let the list of references to allocation units be set up by an 
apparatus using the method according to the invention itself. In this way, the method 
according to this embodiment may be carried out as a backgrovmd task on the apparatus. 
10 Furthermore, by building the list of references to allocation units by the 

method according to this invention, the list may be updated. In this way, the method 
according to the invention also deals with problem allocation imits that grow during use of 
the first mCTiory. 

In a further embodiment of the invention, the data is a stream of audio-visual 

1 S data and the file is retrieved in a sequence dictated by the host. 

As already explained, the use of the method according to the invention is 
advantageous when the requested data is a stream, retrieved in sequence. Playback of this 
stream may be controlled by the host, by trick-play contunands or just by a play command. 

The apparatus according to the invention is characterized in that the central 

20 processing unit is conceived to: determine in which allocation units the requested data is 

stored; search a list of references to allocation vmits to determine whether the list comprises a 
reference to at least one of the allocation units in which the requested data is stored; when at 
least one allocation unit in which the requested data is stored is comprised in the list, store the 
data stored in the at least one allocation unit in a second memorjr, and retrieve the requested 

25 data, wherein a first part of the requested data stored in the second memory is retrieved fix>m 
the second memory and a second part of the requested data is retrieved from the first 
memory, the second part of the requested data is complementary to the Gxst part of the 
requested data. 

The system according to the invention comprises the apparatus as defined in 
30 claim 6 and the first memory. 



Embodiments of the invention will now be presented by means of Figures, in 

which: 
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Figure 1 shows an embodiment of the system according to the invention; 
Figure 2 shows a di^ platter with defective sectors relocated to a spare area; 
Figure 3 is a flow chart representing an embodiment of the method according 
to the invention; 

Figure 4 shows a further embodiment of the^system according to the invention; 

and 

Figure 5 shows a disk platter with a file stored in fragments. 



10 Figure 1 shows an apparatus 100 as an embodiment of the apparatus according 

to the invention. The apparatus 100 comprises a central processing imit 101, a harddisk drive 
system 102, a cache memory 103 and a video processor 104. Li this embodiment, the 
apparatus is adapted to store audio-visual data. To present this audio-visual data, the 
apparatus may be connected to a TV-set 120. 

IS In a further embodiment of the apparatus according to the invention, the 

harddisk drive system 102 is replaced by a disc drive conceived to receive an optical or 
magneto-optical disc like DVD. 

In the retrieval of audio-visual data* delivery of data ia time is more important 
than delivCTy of faultless data. This is because little noise in a film presented on the TV-set 

20 120 will in most cases be less annoying than a blackout of several seconds because the 

harddisk drive system 102 is performing several retries to properly retrieve data that may be 
faulty anyway. Furthermore, data should be delivered constantly and as fast as possible to the 
video processor 104 to prevent any hick-ups in the presentation of the film. 

In use, the quality of the disk platter in the harddisk drive system 102 

25 degrades. This means that certain sectors — the smallest allocation unit on the disk — may 

become permanently defective during use of the harddisk drive system 102. It is known in the 
art that data meant to be stored in such a defective sector is relocated to a spare sector. 

This is shown in Figure 2. Figure 2 shows a disk platter 200 with a spare area 
210 and a readAvrite head 205 on an arm 207. The disk platter 200 is a part of the harddisk 

30 drive system 102. On ttie harddisk, 200, a stream of audio-visual data is stored in area 220. 
Area 220 comprises multiple sectors. Area 220 also comprises a defective sector 225. The 
defective sector 255 has been re-assigned to spare sector 215. This re-assignment is 
administered in a memory (not shown) in the harddisk drive system 102. To the outside 
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world, data is still stored in the defective sector 225, but phj^ically, tbis data is located in the 
spare sector 21 S. 

When the stream of audio-visual data stored in the area 220 is retrieved from 
the disk platter 200, retrieval starts at the location indicated by a first arrow 230. A first part 
5 of the stream of audio-visual data between the first arrow 230 and the second arrow 240 can 
be retrieved easily, because the data is not fragmented. This means that liie data can be 
retrieved in one rotation of the disk platter 200. The disk platter rotates in the direction 
indicated by a third arrow 250. 

However, when the head reaches the defective area 225 to retrieve data that is 

10 logically stored there, the arm 207 has to move to the centre of the disk plattCT 200 so flie 
head 205 is able to retrieve data firom spare area 215. When the data has been retrieved from 
the spare sector 215, the arm 207 has to move to the outside of the disk platter 200 to position 
the head 205 to a location indicated by a fourth arrow 260 to retrieve the last part of the 
stream of audio-visual data. 

1 5 The movement of the arm 207 while retrieving flie stream of audio-visual data 

incurs a considerable performance penalty with respect to retrieval speed, because no data 
can be retrieved while moving the arm 207. 

The performance penalty shows itself as an increased access time and/or an 
average data retrieval rate that is lower than the nominal data retrieval rate of the harddisk. 

20 This kind of performance degradation may produce hick-ups in the retrieval of 

the stream, causing hick-ups in presentation because of buffer underflow, as already 
explained. The invention proposes a method of reducing this speed penalty and preventing 
the hick-ups. An embodiment of the method according to the invention will be discussed with 
reference to Figure 1, Figure 2 and Figure 3. 

25 In the embodiment of the invention presented, the microprocessor 101 

retrieves a Ust with defective sectors fcom the harddisk drive system 102. When a file - like a 
stream of audio-visual data - is requested for presentation on the TV-set 120, the central 
processing unit 101 will command the harddisk drive syst^ti 102 to retrieve the file from the 
disk platter 200. This is a starting step 302 in a process depicted by a flowchart 300. In a 

30 subsequent process step 304, the central processing unit 101 determines the area 220 where 
the file is located on the disk platter 200, In a process step 306, the list with defective sectors 
is checked to see whether the area 220 where the file is to be retrieved comprises defective 
sectors 225. In a decision step 308 it is determined whether this is actually the case. 
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When the area 220 comprises defective sectors 22S, tiie data in the relocated 
sector 215 is retrieved and stored in the cache memory 103 in a process step 320. Following 
the process st^ 320, the file is retrieved firom the harddisk drive system 102, until data to be 
retrieved is located in the spare sector 215. As explained before, the data is logically stored in 
tiie defective sector 225 and physically stored m the spare sector 21 5, When data to be 
retrieved is located in the spare sector 215, the data retrieved previously &om the spare sector 
215 is retrieved jfrom the cache memory 103 in a process step 324. Subsequently, in a 
decision step 326, it is checked whether the file has been fully retrieved. When this is not title 
case, the process depicted by the flowchart 300 is continued in the process step 322 in which 
the last part of the file is retrieved. When, in the decision step 326, it is detected that the fiill 
file has been retrieved, the process is stopped in a terminator 312. 

Since in the process step 324 the data stored in the relocated sector is retrieved 
fiom the cache memory 103, the arm 207 does not have to move to the ^are area 210 and the 
head 205 does not have to be positioned to the spare sector 215. This yields a considerable 
gain in data retrieval ^eed of the harddisk drive system 102 as well as of the total apparatus 
100. 

Whoi, in the decision step 308, it is detected that the area where the file is 
stored does not comprise any defective sectors,- the fiill file is retrieved at once from tiie 
harddisk drive system 102. When the file has been fiiUy retrieved, the process is stopped in 
the terminator 3 12. 

For proper execution of the method described by means of the flowchart 300, 
it should be known which sectors are relocated or which sectors incur performance penalties 
in general. 

It is possible to measure the whole drive, but this is time-consuming. 
However, this could be done over a prolonged period, preferably when the apparatus 
conceived to execute the method depicted in Figure 3 is in an idle mode. In this embodiment 
of the invention, the fiiU drive is scanned and the average data retrieval rate is measured. 
When the average retrieval rate drops below the nominal retrieval rate of the harddisk drive 
as specified by the manufacturer, this is registered and the address of the sector where data is 
stored of which flie retrieval causes the drop of the average retrieval rate is stored in a Ust. 

A second solution wo\ild be to monitor all requests and flag any conunand that 
takes longer than expected. Suspect areas comprising data of which the reading and/or 
writing takes longer than expected could then be fiarther examined, reducing the need to scan 
the whole disk. 
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The optimal solution is to get the information from the harddisk drive system 
itself. Within the HDD, information on relocated sectors is available, but the only problem is 
how to extract it For future harddisk systems, this mi^t be possible. 

Figure 4 shows an apparatus 400 as a further embodiment of the apparatus 
5 according to the inv^tion. The apparatus 400 comprises a central processing unit 401, a 
harddisk drive system 402 and a video processor 404, The apparatus 400 is conceived to 
retrieve a stream of audio-visual data from the harddisk drive system 402 and process it with 
the video processor 404. The video processor 440 converts the data received from the 
harddisk drive system 402 into a signal presentable on a TV-set 420. 

10 The harddisk drive system 402 comprises a cache memory 403. When the 

harddisk drive system 402 is requested to send a file - in this embodiment a stream of audio- 
visual information - to the video processor 404, die harddisk drive system 402 checks 
whether the area on a disk platter of the harddisk drive system 402, where the requested file 
is stored, comprises defective and therefore relocated sectors. The defective sectors are 

1 5 relocated to spare sectors in a spare area on the disk platter. When the area where the 

requested file is stored comprises relocated sectors, the information in the spare sectors is 
read prior to the retrieval of the full file. 

When, during the retrieval of the file, data from the relocated sectors should be 
retrieved, this data is not retrieved from the correspondmg spare sectors but from the cache 

20 memory 403. 

In this embodiment of the invention, the harddisk drive system 402 should 
know where a full file is stored on the disk platter. This means that the harddisk drive system 
402 needs knowledge of the file system of die apparatus 400. 

In die embodiments described, data in spare areas is cached. However, in 
25 further embodiments, also data of which reading takes more time to read for any other reason 
migjit be cached. An example of tiiis is presented in Figure 5. Figure 5 shows a disk platter 
500, on which a stream of audio-visual data is stored in fragments, and an arm 502 with a 
read/write head 504. Fragmented storage may occur when streams are merged or when only 
little free space is available on the disk platter 500. The stream of audio-visual data is stored 
30 in a first area 510, a second area 520 and a third area 530. 

Streaming of the data woxild necessitate the arm 502 with read/write head 504 
to skip from the location shown by a first arrow 512 to the second area 520 so as to retrieve 
data. When data from the second area 520 has been retrieved, the arm and read/write head 
504 has to skip again to the location indicated by the first arrow 512 so as to retrieve data 
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from the first area 510 again. This will continue until Hie read/write 504 head reaches a 
location indicated by a second arrow 514. When this location is reached, the arm 502 with the 
read/write head 504 has to skip to the third area 530. When the data &om the third area 530 
has been retrieved, the arm 502 has to skip back to the location indicated by the second arrow 
5 5 14 to retrieve the last data of the stream firom the first area 510. 

The skipping of the arm 502 and the read/write head 504 consumes a 
considerable amount of time. When, prior to the retrieval of the stream of audio-visual 
information, the data stored in the second area 520 and the third area 530 is cached, retrieval 
of the stream requested can be done faster than in the conventional way. 

10 In a further embodiment of the invention, only data stored in the first part of 

the second area 520 and the data in the first part of the third area 530 is cached prior to 
retrieval of the fiill stream of audio-visual data. In fins way, the gap in information retrieval 
by the harddisk drive system caused by switching of the arm 502 is filled by retrieving data 
fix)m the cache memory. This reduces the need for memory space in &e cache as compared to 

15 the previous embodiment. 

Also other performance penalties like soft defects may be considered for 
caching prior to streaming a file. Soft defects occur at locations where the quality of the disk 
platter is degrading, but where data can still be read after a few retries. In this way, soft 
defects cause performance penalties as well. 

20 Of course, retrieval and caching of spare sectors consumes time, just as 

sweeping of an arm with a read/write head during retrieval of the fiill stream. However, 
current disk platters have a fairly good quahty and they do not degrade very fast, and only 
few sectors have to be relocated to spare sectors in a spare area. Therefore, it will only take a 
few hundred milliseconds to cache data that is stored in spare sectors, at start-up. Most users 

25 prefer some delay at start-up over hick-ups during display of the audio-visual data. 

The embodiments described above are merely illustrative for the broader 
scope of the invention and are not limitative. For example, any person skilled in tiie art will 
imderstand that the method according to the invention may be appUed to ofiier kinds of 
memories as well, like opto-magnetic discs, optical discs like CD, SAC3), DVD and Blue- 

30 Ray and the like. 

In summary, the invention relates to a method of caching data stored in 
allocation xmits of a memory (102), preferably a harddisk drive system, of which retrieval 
incurs a performance penalty. An example of this is data in a spare sector (215), located in a 
spare area (210) on the harddisk platter (200). The cache memory (103) is, however, a 
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precious commodity. The need for memory space may be reduced by only caching data in 
spare sectors in which data belongmg to a file that is retrieved is stored. Also the irnpact of 
other kinds of causes of performance penalties may be solved in this way, like those caused 
by soft defects and fragmentation of files. 



